A Data Acquisition System Based on Outlier Detection Method for Weighing Lysimeters
نویسندگان
چکیده
The weighing lysimeters provide scientist the basic information for research related to the evapotranspiration, high quality of the collected data from lysimeters is of great significance. However there are many factors that can affect the measurement accuracy of the weighing lysimeter. In this paper, a data acquisition system was developed to collect the data from 24 weighing lysimeters. The calibration process of the load cell was described. An outlier detection method based on the 3-sigma rule and the median filter was proposed to improve the measurement accuracy of the weighing lysimeters. The performance of the proposed method was compared with the method based on Savitzky-Golay filter. Results show that the standard deviations of the 15-point median filter and the 15-point Savitzky-Golay filter applied to the 283 data points were 0.413Kg and 0.422Kg respectively, which means that the performance of the median filter was better than the Savitzky-Golay filter. Moreover the outliers were successfully eliminated using the median filter and were not removed by the Savitzky-Golay filter.
منابع مشابه
Outlier Detection Using Extreme Learning Machines Based on Quantum Fuzzy C-Means
One of the most important concerns of a data miner is always to have accurate and error-free data. Data that does not contain human errors and whose records are full and contain correct data. In this paper, a new learning model based on an extreme learning machine neural network is proposed for outlier detection. The function of neural networks depends on various parameters such as the structur...
متن کاملIdentification of outliers types in multivariate time series using genetic algorithm
Multivariate time series data, often, modeled using vector autoregressive moving average (VARMA) model. But presence of outliers can violates the stationary assumption and may lead to wrong modeling, biased estimation of parameters and inaccurate prediction. Thus, detection of these points and how to deal properly with them, especially in relation to modeling and parameter estimation of VARMA m...
متن کاملA statistical test for outlier identification in data envelopment analysis
In the use of peer group data to assess individual, typical or best practice performance, the effective detection of outliers is critical for achieving useful results. In these ‘‘deterministic’’ frontier models, statistical theory is now mostly available. This paper deals with the statistical pared sample method and its capability of detecting outliers in data envelopment analysis. In the prese...
متن کاملCompensation of Doppler Effect in Direct Acquisition of Global Positioning System using Segmented Zero Padding
Because of the very high chip rate of global positioning system (GPS), P-code acquisition at GPS receiver will be challenging. A variety of methods for increasing the probability of detection and reducing the average time of acquisition have been provided, among which the method of Zero Padding (ZP) is the most essential and the most widely used. The method using the Fast Fourier Transform (FFT...
متن کاملOutlier Detection for Support Vector Machine using Minimum Covariance Determinant Estimator
The purpose of this paper is to identify the effective points on the performance of one of the important algorithm of data mining namely support vector machine. The final classification decision has been made based on the small portion of data called support vectors. So, existence of the atypical observations in the aforementioned points, will result in deviation from the correct decision. Thus...
متن کامل